Self-similarity in Message Passing Parallel Processing Communication
نویسندگان
چکیده
Communication performance analysis of message passing parallel programs relies on accurate modeling of cluster network traffic patterns. To this end we have developed a tool for collecting traffic samples by simulating parallel processing environment with statistically tractable network traffic. Our results from experiments show network packet traffic generated by messagepassing parallel programs in a Beowulf cluster setting exhibits strong self-similarity, which was tested using Hurst parameters. As most known Hurst parameter estimators are heuristics, we propose a novel approach for statistical inference via parametric bootstrapping, and show confidence intervals of the estimated parameters. The empirical results demonstrate the usefulness of the traffic generation tool as well as the Hurst parameter interval estimation method in the investigation of parallel processing communication performance.
منابع مشابه
Parleda: a Library for Parallel Processing in Computational Geometry Applications
ParLeda is a software library that provides the basic primitives needed for parallel implementation of computational geometry applications. It can also be used in implementing a parallel application that uses geometric data structures. The parallel model that we use is based on a new heterogeneous parallel model named HBSP, which is based on BSP and is introduced here. ParLeda uses two main lib...
متن کاملA Message-Passing Distributed Memory Parallel Algorithm for a Dual-Code Thin Layer, Parabolized Navier-Stokes Solver
In this study, the results of parallelization of a 3-D dual code (Thin Layer, Parabolized Navier-Stokes solver) for solving supersonic turbulent flow around body and wing-body combinations are presented. As a serial code, TLNS solver is very time consuming and takes a large part of memory due to the iterative and lengthy computations. Also for complicated geometries, an exceeding number of grid...
متن کاملTrading Replication for Communication in Parallel Distributed-Memory Dense Solvers
We present new communication-efficient parallel dense linear solvers: a solver for triangular linear systems with multiple right-hand sides and an LU factorization algorithm. These solvers are highly parallel and they perform a factor of 0.4P1/6 less communication than existing algorithms, where P is number of processors. The new solvers reduce communication at the expense of using more tempora...
متن کاملA Practical Method to Implement Asynchronous Iterative Algorithms on MPI and a Case Study for Asynchronous Self-Organizing Maps
In this paper, an effective implementation scheme for asynchronous parallel iterative algorithms on messagepassing systems using MPI non-blocking communication model is proposed. The main idea of the method is to use a MPI_IPROBE function to check for the existence of pending messages without receiving them, thereby allowing us to write programs that interleave local computation with the proces...
متن کاملShared Memory Versus Message Passing for Iterative Solution of Sparse Irregular Problems
The benefits of hardware support for shared memory versus those for message passing are difficult to evaluate without an in-depth study of real applications on a common platform. We evaluate the communication mechanisms of the MIT Alewife machine, a multiprocessor which provides integrated cache-coherent shared memory, message passing, and DMA. We perform this evaluation with “best-effort” impl...
متن کامل